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We propose a simple complexity indicator of classical Liouvillian dynamics, namely the separa- 
bility entropy, which determines the logarithm of an effective number of terms in a Schmidt de- 
composition of phase space density with respect to an arbitrary fixed product basis. We show that 
linear growth of separability entropy provides stricter criterion of complexity than Kolmogorov-Sinai 
entropy, namely it requires that dynamics is exponentially unstable, non-linear and non-markovian. 

PACS numbers: 05.45.Pq 



I. INTRODUCTION 

How can one characterize algorithmic complexity of 
Liouville evolution dp* /dt = {p*, -Hjpoisson bracket of con- 
servative classical dynamics with Hamiltonian HI Is 
Kolmogorov-Chaitin complexity of individual orbits re- 
lated to complexity of field solutions p t (z) {z denoting 
a collection of 2d phase space coordinates) of Liouville 
equation? The answer is 'no', as shown by a paradig- 
matic example of chaotic dynamics, the stretching and 
folding baker's map, which is equivalent to the Bernoulli 
shift on an infinite binary symbol sequence (coin tossing) , 
so its orbit dynamics is algorithmically complex, but its 
Liouville evolution is exactly solvable pQ . More generally, 
one can identify two extreme cases of exact solvability in 
conservative (closed and noise-less) classical dynamics: 
namely (i) orbit-wise exact solvability which is associated 
with a Liouville integrability and existence of a complete 
set of constants of motion, and (ii) field-wise exact solv- 
ability which is associated with an existence of a finite 
Markov partition and symbolic dynamics [21 [3] . 

The fundamental question that we address in this pa- 
per is whether the notion of complexity qualitatively 
changes when we focus our attention from individual or- 
bits to time-dependent statistical ensembles? The latter 
is more common and meaningful in statistical mechanics. 
We propose to apply a concept of a Schmidt rank and en- 
tanglement entropy - common in quantum information 
theory 4 - to a joint probability distribution of several 
classical (dynamical) variables, in order to describe the 
growth rate of complexity of description of classical field 
solutions of the Liouville equation. In this way, a new and 
conceptually very simple measure of complexity is de- 
fined, the separability complexity, which exactly vanishes 
in both cases (i,ii) of exact solvability and thus hopefully 
detects genuinely hard cases of classical deterministic dy- 
namics, even in the statistical sense. The utility of the 
new measure is demonstrated and compared to the char- 
acteristics of the transport and diffusion in the Fourier 
space (being common measures of Hamiltonian turbu- 
lence) for several non-trivial examples of chaotic and reg- 
ular 2D and 4D classical dynamical maps. One should 
note that introducing either classical noise or quantum 
effects introduces a natural cutoff scale to a phase space 



resolution and thus qualitatively reduces such a notion 
of complexity. Quantum, or noisy classical dynamics can 
become genuinely complex only in the (thermodynamic) 
limit of increasingly many degrees of freedom. 

II. SEPARABILITY ENTROPY AND 
COMPLEXITY INDICATORS 

In order to make our discussion simple but general we 
shall consider discrete dynamical systems, say strobo- 
scope or Poincare maps of Hamiltonian dynamics, given 
in terms of a Lebesgue-measure preserving invertible map 
z t +i — 4>(z t ) over a compact phase space M C R 2d . 
The map induces a unitary Perron-Frobenius operator 
over the Hilbert space L 2 (Ai) of phase space densities, 
{U p)(z) = p{<p^ 1 (z)). For simplicity we shall identify 
the phase space with 2d— dimensional torus A4 = T 2d 
(while more general cases can be treated with obvious 
modifications) and consider an arbitrary phase space de- 
composition Ai = T d T d 3 z = (x, y) into two sets 
of d coordinates, which could for example, describe two 
disjoint subsets of degrees of freedom, or x could be po- 
sitions and y momenta, etc. The phase space decomposi- 
tion induces factorization of the Hilbert space of densities 
L 2 (M) = L 2 {T d )®L 2 {T d ). Let us write time-evolved Li- 
ouville density as p t (x,y) = (U l p°)(x,y), and normalize 
it in L 2 sense as J d 2d z\p t (z)\ 2 = 1. Then we write the 
Schmidt (or singular value) decomposition of the density 

p\x, y)=J2 v n( x )i*W n (v)i (!) 

n 

in terms of two sets of ortho-normalized functions {v^}, 
n = 1,2... and a set of Schmidt coefficients 
{p\ > p\ > • ■ ■ > 0} satisfying J2 n \p t n \ 2 = 1. In prac- 
tice, we can treat p l {x, y) as a matrix of row x and col- 
umn y and consider sufficiently fine discretization of con- 
tinuous variables x, y G T d that the results don't depend 
on it. Let us define a separability entropy (s-entropy) as 
a logarithm of an effective number of terms in decompo- 
sition 

Mp 4 ]--ERl 2ln l^l 2 ( 2 ) 

n 



2 



which gives a quantitative measure of separability of 
phase-space density with respect to a given phase space 
decomposition. Alternatively, h[p l ] can be computed as 
von Neuman entropy hip 1 ] = — tr[i?* lni?*], where i?* 
are trace-class, positive, self-adjoint operators on L 2 (T d ) 
with integral kernels i?*(a;,a;') = j d d yp t (x, y)p t (x', y). 
Note that s-entropy /i[p'] does not depend on the coor- 
dinate system we use for each phase-space factor space, 
since decomposition is invariant under invertible mea- 
sure preserving transformations of the form (x,y) — > 
(xi x ), v{y))j namely it only depends on phase-space de- 
composition and dynamics <p. Any nontrivial decompo- 
sition can be generated from a canonical one in terms of 
some phase-space diffcomorphism tv : M — > M, namely 
z = Tv(x,y), and the corresponding s-entropy is com- 
puted as o 7r]. Now, let us assume that for suf- 
ficiently complex dynamics s-entropy can grow propor- 
tionally with time, and define its asymptotic growth rate 
as s- complexity 
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C s [<p] = inf sup lim -h[p° o <p 

7T „ t— >00 t 



-t 



O 7rl 



(3) 



with, taking first a supremum over initial densities p°, 
and later an infimum over the phase-space decomposi- 
tions 7r [5] . Clearly, any complete and accurate (numer- 
ical) representation of phase space density p l needs at 
least e>(expO[p*])) terms of the form 0, so 0{exp(C s t)) 
estimates [5] the necessary amount of classical comput- 
ing resources needed to simulate Liouville dynamics up 
to time t, but is it sufficient? 
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FIG. 1. Snapshots at t = 3,5,7 (top-down) of Liouville dy- 
namics starting from initial density p t=0 (x, y) = (2 + cos a; + 
cosy) (2-kVE), for the four 2D toral maps (PC, SM, IM, TM, 
left-right) introduced in the text. The grayscale indicates the 
probability density p t (x,y) (zero=white, maximal=black). 

As an alternative measure of algorithmic complexity 
of Liouville dynamics we define the Fourier entropy (f- 
entropy), as the logarithm of an effective number of 
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FIG. 2. Snapshots at t = 3, 5, 7 (top-down) of Liouville den- 
sity in Fourier space p t (k x ,k y ), starting from p°(k x ,k y ) tx 
,o<5fc H ,o + ^|fc x |,i<5fc y ,o + £fcx,o<5|fc„|,i, for the four different 2D 
toral dynamics (PC, SM, IM, TM, left-right) introduced in the 
text. The grayscale indicates probability density (zero= white, 
maximal=black), while axes labels K x and K y indicate the 
Fourier space range [— K x , K x ] x [— K y ,K y ] which is scaled 
(both, in x and y direction) with the map's Lyapunov expo- 
nent exp(iA m ax) from top to bottom panels. 



Fourier harmonics /5*(fc) = (2tt) 2d J d 2d ze lk ' z p t (z), k e 
Z 2rf , needed to simulate the solution for time t, namely 



9\f] = - E IP*(fc)| 2 ln|p*(fe)| 5 



and the corresponding f-complexity as 

C t [<p] = sup lim g[p° o </>-*] ft. 

p0 t-yca 



(4) 



(•5) 



C(exp(Cft)) gives a sufficient amount of classical com- 
puting resources needed for accurate simulation of Liou- 
ville dynamics up to time t, but is it necessary! Summa- 
rizing, we state the following two inequalities: 



C s < Q < 2d\ n 



(6) 



where A max is the maximal Lyapunov exponent which 
determines the smallest scale ~ exp(— A max i) on which 
p t {z) can vary, in each of 2d phase space directions. 

For the first inequality ^ to be saturated it would 
mean that both, s-complexity and f-complexity yield suf- 
ficient and necessary amount of computing resources for 
Liouvillian simulation. As indicated later in numerical 
experiments, this may not generally be true. Fo the sec- 
ond inequality ^ to be saturated, it is required that the 
I-dimcnsional unstable manifold along the maximally un- 
stable Lyapunov direction densely covers a finite-measure 
portion of the 2c? dimensional phase space, and moreover, 
that the exploration of the modes of the Fourier space is 
not sparse, as is for example in the case of linear automor- 
phisms on the torus (cat maps). This may typically be 
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FIG. 3. Separability entropy h(t) = h[p ] (a,b) and Fourier 
entropy g(t) = g[pt] ( c ,d) for two cases of chaotic dynamics, 
PC (a,c) and SM (b,d). Discretization/trucation with N = 2 P 
nodes in real/Fourier-space along each (x and y) direction is 
used, and data for p = 14 (black, full curves/symbols), p = 13 
(dark grey, short dash), andp = 12 (light grey, long dash) are 
shown. For p — 12, 14 we use the same initial density p° as 
in Figs TJ2 while for p = 13 (only for PC) a different initial 
state with Fourier harmonics populated up to |fc| = 4 is used 
in order to demonstrate the same asymptotic growth rates, 
indicated with dash-dotted lines: C s = 1.00 (a), C s = 0.952 
(b), Ct = 2A^ x = 1.90 ( C ), Cf = = 1-64. 



FIG. 5. Singular value (Schmidt) spectra as a function of 
time for t = 3 (full curves), t = 5 (long dashed), t = 7 (short 
dashed), for the dynamics: PC (a), SM (b), IM (c), TM (d) 
using discretization dimension N = 2 14 . log u(n), with u(n) = 
\Pn\ 2 , is plotted against logn, and in non-chaotic cases (c,d), 
the dash-dotted line indicates u(n) oc 1/n 2 scaling. 



solvability of Liouville dynamics due to chaotic motion 
and non-existence of a finite Markov partition. 



III. NUMERICAL EXAMPLES 



the case - as indicated later - at least in low dimensional 
maps. 
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FIG. 4. Separability entropy hit) = (lower curves) and 

Fourier entropy g(t) = g[pt] (upper curves) for non-chaotic 
dynamics, integrable IM (a), and non-integrable TM (b). 
Data for discrectization dimension N = 2 P with p = 14 (black 
curves), and p = 12 (grey curves) are shown, where dash- 
dotted lines suggest asymptotic logarithmic growths ~ £hit, 
with £ = 0.333 (s-entropy for IM), £ = 0.667 (f-entropy for 
IM), I = 1.0 (s-entropy for TM), £ = 2.5 (f-entropy for TM). 

It is interesting to note that for any map with a finite 
Markov partition - and thus admitting exact symbolic 
dynamics with a finite grammar - we have C s = since 
in the Markov coordinates the separability (or the num- 
ber of terms in (JlJ) is preserved. For linear toral (cat) 
maps we even have Cf = since the number of Fourier 
harmonics is preserved in time even though their magni- 
tude may be growing. Positive s-compexity, C s > 0, thus 
represents a very strong condition implying practical un- 



Let us now illustrate our concepts by discussing a set 
of numerical experiments. Firstly, we consider four dif- 
ferent examples of 2D (d — 1) symplectic toral maps, 
(a/, y') = cp(x,y): (i) perturbed cat map (PC) (as in 
7\) y 1 = y + x — as\a.x,x' = x + y' with a — 0.5 as 
an example of non-linear, non-markovian but uniformly 
hyperbolic Anosov system, (ii) non- symmetric standard 
map (SM) y' = y + cvsinx + (3 cos(2a;), x' = x + y' with 
a = 2,(3 = 2 as an example of strongly chaotic but 
non-uniformly hyperbolic system with small islands of 
regular motion of negligible area, (iii) integrable (Suris) 
map [8] (IM) x' = 2x + 4arg(l + ae~ ix ) - y,y' = x 
with a = 0.5 as a an an example of a non-trivially in- 
tegrable map with a separatrix, (iv) triangle map [S] 
(TM) y' = y + asgn(x - ir) + f3,x' = x + y' with 
a = 7r(v5 — l)/2,[3 = 7re _1 as an example of dynam- 
ically mixing system without exponential sensitivity (all 
assignments understood mod 2tt). In Fig. [l] we show 
time evolving phase space densities p~ l for all four maps 
at t = 3, 5, 7, all starting from the same simple initial 
density p°(x, y) = (2 + cosx + cos y) (27r-\/5) . Note that 
the three maps PC, SM and TM exhibit dynamical mix- 
ing behavior, although for TM the mixing mechanism 
is qualitatively different [TO]. Only the orbits of the 
first two maps (PC and SM) have positive Kolmogorov 
complexity, with estimated Lyapunov exponents (being 
equal to Kolmogorov-Sinai entropies) A^ x = 0.9496, 
^max — 0.8206, and only PC exhibits exponential de- 
cay of correlations, J d 2 z p Q (z) p* (z) — 1 ~ exp(— £t), 
with £ PC = 1.17, while for SM and TM correlations 
decay as power laws. In Fig. [2] we display the corre- 
sponding Fourier transformed densities p^ 1 in order to 
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demonstrate the exponential expansion of the distribu- 
tions of Fourier harmonics in the chaotic cases (PC,SM), 
resulting in a positive f-complexity. Indeed, as we show 
in Fig. [3j the f-entropy grows linearly with the upper 
bound Lyapunov rate Q, namely Cf = 2A max which we 
believe should be a generic behavior for chaotic maps, 
whereas for s-complexity we find consistently smaller val- 
ues C S PC = 1.00, C S SM " = 0.952. Note that completely 
different behavior is found for linear chaotic maps, or 
maps with exact symbolic dynamics like un-perturbed 
cat map or baker's maps, where we find C s = 0. In 
non-chaotic maps (IM,TM) we find zero s/f-compexity, 
where the temporal growth of s/f-entropy is likely to be 
logarithmic (see Fig. [4] and its caption for details) . 

The numerical results on s-complexity are supple- 
mented by showing the temporal snapshots of the full 
Schmidt spectrum p} n in Fig. [5j In the chaotic cases 
(PC, SM) with positive s-complexity, the full spectrum 
asymptotically scales as p} n oc f(n/(C B t)), and the tail 
of f(x) decays faster than the power law, while in the 
regular/non-chaotic cases (IM, TM), p} n converges, as 
t — > oo, to a universal power-law profile pr n — ► const/n. 

Secondly, we consider an example of 4D (d = 2) toral 
automorphism, a simple extension of a perturbed cat 
map to T 4 , 4>( z ) = i z 'i + Pi sin z' 3 ,z' 2 + 02 sin z' 4 ,z' 3 ,z' 4 ), 
and z' = Cz. As for linear part we take exactly the same 
two cases as in Ref. namely the doubly-hyperbolic 

(DH), and loxodromic (Lo) one, with 4x4 matrices 



Cdh = 




Clo — 




and take non-linearities fi\ = 0.2, /3 2 = 0.3, resulting in, 
respectively, maximal Lyapunov exponents Aj^x = 1-60, 
^max = 0.525. Decomposing x = (z 1 ,z 2 ),y = (z 3 ,Z4), 
we show in Figj6]numerical simulation of s- and f-entropy, 
starting from the initial state with random lowest Fourier 
harmonics, i.e. being independent random complex 
Gaussian variables for k ■ k < 1 and = other- 
wise. Again, we obtain, consistently with the 2D case, 
that the f-entropy grows with the rate which is close to 
4A max , saturating the second bound in ([6 1, and that the 
s-complexity is systematically substantia ly smaller but 
positive, namely Cf H = 2.95^ C* s Lo = 1.12. 

It should be noted that our numerical experiments pro- 
vide only a partial support for the meaningfulness of the 
definitions and conjectures stated in Section II, although 
the results seem very suggestive. For example, the supre- 
mum over initial density p° has been tested by increasing 
the Fourier support of p , which typically did not result 
in appreciable difference in the asymptotic growth rate 
of hip 1 ]. On the other hand, we have not yet been able to 
address systematically the infimum over the phase space 
partitions n in the definition ([3]). However, several tri- 
als of varying tt indicated that the numerical result - the 
value of C s - may indeed be insensitive to composing with 
(smooth) 7T, whereas it seems very plausible that for non- 
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FIG. 6. Separability entropy h(t) = hip 1 ] and Fourier entropy 
g(t) — g[p ] for 4D perturbed cat maps: DH (a) and Lo (b). 
We take discretization/truncation to N = 2 P nodes in each of 
4 phase space directions with p = 7 (black - full curves) and 
p — 6 (gray - dashed curves), initial state described in text. 
The chain straight lines give the suggested asymptotic rates, 



2.95 (a), Ct° = 1.12 (b), C" 
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(c,d). 



smooth 7r the asymptotic growth rate of h\p o o ir] 
cannot lower. Furthermore, it would be a future chal- 
lenge to come up with analytically solvable examples of s- 
complcx Lyiouville dynamics where the positivity C s > 
could be rigorously proven. 



IV. CONCLUSION 

We have proposed a simple quantitative measure of 
complexity of classical non-dissipative Liouvillian dy- 
namics. The so-called separability entropy (whose 
asymptotic growth rate defines what we call s- 
complexity) is inspired by the entanglement entropy [U 
of quantum states, adapted to classical joint probability 
distributions of several, or many variables. Note that 
a similar complexity measure in the quantum Liouville 
space (or operator space) has been used as an indicator of 
quantum dynamical complexity and quantum chaos [12j . 
It has been argued here that the separability entropy 
measures the minimal amount of computation resources 
needed to simulate the classical Liouvillian evolution. 
Based on simple numerical examples of discrete time dy- 
namical systems on 2D and 4D compact phase space 
we have demonstrated that s-complexity is non-trivial 
and typically smaller than the exponential growth rate 
of the number of Fourier harmonics (f-complexity). For 
example, for Hamiltonian dynamics with many degrees 
of freedom one might encounter interesting situations 
with strong Hamiltonian turbulence (large f-complexity) , 
which may be efficiently simulable by a classical version of 
time-dependent density matrix renormalization group (a 
la [T3]) if s-complexity is small. Our concept is fundamen- 
tally different from other popular complexity measures 
in chaos theory, such as the Kolmogorov-Sinai entropy, 
which characterize complexity of individual trajectories 
and often fail to provide any meaningful complexity in- 
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formation about the time-dependent Liouvillian density. 

Our concepts have interesting quantum extensions. 
We note that f-complexity has already been used in 
order to characterize the complexity of quantum time 
evolution in terms of a Wigner function [H] . We suggest 
that s-complexity could have a similar quantum phase 
space extension, but providing a sharper discriminant 



between quantum chaotic and quantum regular motions. 
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